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We give a new general definition of arity, yielding the companion notions of signature and associated 
syntax. This setting is modular in the sense requested by [12]: merging two extensions of syntax 
corresponds to building an amalgamated sum. These signatures are too general in the sense that we 
are not able to prove the existence of an associated syntax in this general context. So we have to 
select arities and signatures for which there exists the desired initial monad. For this, we follow a 
track opened by Matthes and Uustalu [16]: we introduce a notion of strengthened aiity and prove that 
the corresponding signatures have initial semantics (i.e. associated syntax). Our strengthened arities 
admit colimits, which allows the treatment of the /1-calculus with explicit substitution in the spirit of 
[12]. 

1 Introduction 

Many programming or logical languages allow constructions which bind variables and this higher-order 
feature causes much trouble in the formulation, the understanding and the formalization of the theory of 
these languages. For instance, there is no universally accepted discipline for such formalizations: that 
is precisely why the POPLmark Challenge [4] offers benchmarks for testing old and new approaches. 
Although this problem may ultimately concern typed languages and their operational semantics, it al- 
ready concerns untyped languages. In this work, we extend to new kinds of constructions our treatment 
of higher-order abstract syntax [13], based on modules and linearity. 

First of all, we give a new general definition of arity, yielding the companion notion of signature. 
The notion is coined in such a way to induce a companion notion of representation of an arity (or of a 
signature) in a monad: such a representation is a morphism among modules over the given monad, so that 
an arity simply assigns two modules to each monad. There is a natural category of such representations of 
a signature and whenever it exists, the initial representation deserves the name of syntax associated with 
the given signature. This approach enjoys modularity in the sense introduced by [12]: in our category of 
representations, merging two extensions of a syntax corresponds to building an amalgamated sum. 

Our notion of aiity (or signature) is too general in the sense that we are not able to build, for each 
signature, a corresponding initial representation. Following a track opened in IVIatthes-Uustalu [16], we 
define a fairly general notion of strengthened arity, yielding the corresponding notion of strengthened 
signature. Our main result (Theorem 7.8) says that any strengthened signature yields the desired initial 
representation. As usual, this initial object is built as a minimal fixpoint. 

Understanding the syntax of the lambda-calculus with explicit substitution was already done in [12], 
where the arity for this construction was identified as a coend, hence a colimit, of elementary arities (see 
Section 8). Our main motivation for the present work (and for our next one) was to propose a general 
approach to syntax (and ultimately to semantics) accounting for this example in the spirit of our previous 
work [14]. This is achieved thanks to our second main result (Theorem 4.3) which states the existence 
of colimits in the category of (strengthened) arities. 
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In this extended abstract, we do not discuss proofs. A complete version is available on-line. 

2 Related and future work 

The idea that the notion of monad is suited for modeling substitution concerning syntax (and semantics) 
has been retained by many recent contributions on the subject (see e.g. [5, 12, 16]) although some other 
settings have been considered. For instance in [15] the authors argue in favor of a setting based on 
Lawvere theories, while in [7] the authors work within a setting roughly based on operads (although they 
do not write this word down). The latter approach has been broadly extended, notably by M. Fiore [8, 
9, 10]. Our main specificity here is the systematic use of the observation that the natural transformations 
we deal with are linear with respect to natural structures of module (a form of linearity had already been 
observed, in the operadic setting, see [11], Section 4). 

The signatures we consider here are much more general than the signatures in [7], and cover the 
signatures appearing in [16, 12]. Note however that the latter works treat also non-wellfounded syntax, 
an aspect which we do not consider at all. 

In our next work, we will propose a treatment of equational semantics for the present syntaxes. This 
approach should also be accommodated to deal with typed languages as done for elementary signatures 
in [17, 18, 2], or to model operational semantics as done for elementary signatures in [1]. 

3 The big category of modules 

Modules over monads and the associated notion of linear natural transformation intend to capture the 
notion of "algebraic structure which is well-behaved with respect to substitution". An introduction on 
this subject can be found in our papers [13, 14]. Let us recall here the very basic idea. 

Let /? be a monad over a base category C. A module over R with range in a category D is a functor 
M: C — > D endowed with an action of R, i.e., a natural "substitution" transformation p: M-R — > M 
compatible with the substitution of R in the obvious sense. Given two modules M,N over the same 
monad and with the same range, a linear natural transformation cp: M N is a. natural transformation 
of functors which is compatible with the actions in the obvious sense. This gives a category Mod'^(/?) of 
modules with fixed base R and range D. 

It is useful for the present paper to consider a larger category which collects modules over different 
monads. For the following definition, we fix a range category D. 

Definition 3.1 (The big module category). We define the big module category BModQ as follows: 

• its objects are pairs (R, M) of a monad /? on C and an /^-module M with range in D. 

• a moiphism from {R,M) to {S,N) is a pair (/,m) where /: R — > 5 is a morphism of monads, and 
m : M — > f*N is a moiphism of /^-modules (here f*N is the functor A'^ equipped with the obvious 
structure of 7?-module). 

4 The category of arities 

In this section, we give our new notion of arity. The destiny of an arity is to have representations in 
monads. A representation of an arity a in a monad R should be a morphism between two modules 
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dom{a,R) and codom(a,/?). For instance, in the case of the arity a of a binary operation, we have 
dom(a,R) := and codom(a,R) := R. Hence an arity should consist of two halves, each of which 
assigns to each monad R a module over /? in a functorial way. However, in all our natural examples, we 
have codom(a,/?) = 7? as above. Although this will no longer be the case in the typed case (which we do 
not consider here), we choose to restrict our attention to arities of this kind, where codom(a,/?) is R. 

From now on we will consider only monads over the category Set and modules with range Set. For 
technical reasons, see Section 7, we restrict our attention to the category of tj-cocontinuous endofunctors 
that we will denote End'^(Set). Analogously we will write Mon'^ (resp. BMod'^) for the full subcategory 
of monads (resp. of modules over these monads) which are w-cocontinuous. 

We recall that finite limits commute with filtered colimits in Set. It follows that End'^(Set) has finite 
limits and arbitrary (small) colimits. This is the key ingredient in the proofs of cij-cocontinuity for most 
of our functors. 

Definition 4.1 (Arities). An arity is a right-inverse functor to the forgetful functor from the category 
BMod'^ to the category Mon'^. 

Now we give our basic examples of arities: 

• Every monad R is itself a /?-module. The assignment Rt-^ R gives an arity which we denote by 0. 

• The assignment R i-> *r, where *r denotes the final module over R is an arity which we denote by *. 

• Given two arities a and b, the assignment R i-^ a(R) x b{R) is an arity which we denote hy axb . In 
particular 0^ = x is the arity of any (first-order) binary operation and, in general 0" is the arity 
of n-ary operations. 

• Given an endofunctor F of Set, we consider the derived functor given by F' : X i-> F(X + *). It can 
be checked how when F is a module so is F'. Given an arity a, the assignment R i-^ «(/?)' is an arity 
which we denote a' and is called derivative of a. 

• Derivation can be iterated. We denote by a*-"^ the n-th derivative of a. Hence, in particular-, we have 

• For each sequence of non-negative integers s = (si,..., s„), the assignment R i-> 7?^*'* x • • • x/?^*"^ is an 
arity which we denote by 0^*\ Arities of the form 0^*^ are said algebraic. These algebraic arities are 
those which appear in [7]. 

• Given two arities a, b their composition a-b :=R^ a{R) ■ b{R) is an arity. 

Definition 4.2. A morphism among two arities a\,a2: Mon'^ — > BMod'^ is a natural transformation 
m: a\ — > a2 which, post-composed with the projection BMod'^ — > Mon*^, becomes the identity. We 
easily check that arities form a subcategory Ar of the category of functors from Mon'^ to BMod'^. 

Now we give two examples of morphisms of arities: 

• The natural transformation /i : • — > induced by the structural composition of monads is a 
morphism of arities. 

• The two natural transformations • 77 and 77 • from to • are morphisms of arities. 
Tlieorem 4.3. The category of arities has finite limits and arbitrary (small) colimits. 

5 Categories of representations 

Definition 5.1 (Signatures). We define a signature E = {0,a) to be a family of arities a: O — > Ar. A 
signature is said to be algebraic if it consists of algebraic arities. 
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Definition 5.2 (Representation of an arity, of a signature). Given an oj-cocontinuous monad R over Set, 
we define a representation of tiie arity a in /? to be a module morphism from a{R) to /?; a representation 
of a signature Z in /? consists of a representation in R for each arity in E. 

Example 5.3. The usual app : — > A is a representation of the arity 0^ into the monad A of /l-calculus 
8. 

Definition 5.4. Given a signature S = {0,a), we build the category Mon^ of representations of E as 
follows. Its objects are a»-cocontinuous monads equipped with a representation of S. A morphism m 
from (M, r) to (A'^, s) is a morphism of monads from M to N compatible with the representations in the 
sense that, for each o in O, the following diagram of M-modules commutes: 

ao(M) — M 

ao(m) 

m*(ao{N)) - — ^ m*N 

m So 

where the horizontal arrows come from the representations and the left vertical arrow comes from the 
functoriality of arities and m : M — > m*N is the morphism of monad seen as morphism of M-modules. 

These morphisms, together with the obvious composition, turn Mon^ into a category which comes 
equipped with a forgetful functor to the category of monads. 

We are primarily interested in the existence of an initial object in this category Mon^. 

Definition 5.5. A signature E is said representable if the category Mon^ has an initial object, which we 
denote Z. 

Theorem 5.6. Algebraic signatures are representable. 

For more details we refer to our paper [13] (Theorems 1 and 2). We give below a more general result 
(Theorem 7.8). 



6 Modularity and the big category of representations 

It has been stressed in [12] that the standard approach (via algebras) to higher-order syntax lacks modu- 
larity. In the present section we show in which sense our approach via modules enjoys modularity. The 
key for this modularity is what we call the big category of representations. 

Suppose that we have a signature E - {0,a) and two subsignatures Ei and E2 covering E in the obvi- 
ous sense, and let Eq be the intersection of Ei and E2. Suppose that these four signatures ai^e representable 
(for instance because E is algebraic or strengthened in the sense defined below). Modularity would mean 
that the corresponding diagram of monads 

Eo 5^ El 

y 

E2 ^E 



is a pushout. The observation of [12] is that this diagram of raw monads is, in general, not a pushout. 
Since we do not want to change the monads, in order to claim for modularity, we will have to consider 
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a category of enhanced monads. Here by enriched monad, we mean a monad equipped with some 
additional structure, namely a representation of some signature. 

Our solution to this problem goes thi^ough the following "big" category of representations, which we 
denote by RMon, where R may stand for representation or for rich: 

• An object of RMon is a triple (R, X, r) where /? is a monad, E a signature, and r is a representation of 
Ein R. 

• A morphism in RMon from {R\,{Oi,ai),ri)to iR2,(02,<^2),f'2) consists of an injective map / := Oi — > 
O2 compatible with a\ and a2 and a moiphism m from {R\,r{) to (/?2.'*(''2))> where i*{r2) should 
be understood as the restriction of the representation r2 to the subsignature {0\,a\) where we pose 
i*{r2){o) ■= r2{i{o)). 

• It is easily checked that the obvious composition turns RMon into a category. 

Now for each signature X, we have an obvious functor from Mon^ to RMon, through which we may see £ 
as an object in RMon. Furthermore, an injection / : Ei — > S2 obviously yields a morphism := Zi — > £2 
in RMon. Hence our 'pushout' square of signatures as described above yields a squai^e in RMon. The 
proof of the following statement is straightforward. 

Modularity holds in RMon, in the sense that given a 'pushout' square of representable signatures as 
described above, the associated square in RMon is a pushout again. 

As usual, we will denote by RMon'^ the full subcategory of RMon constituted by a»-cocontinuous 
functors. It is easy to check that the previous statement is equally valid in RMon^. Indeed, recall that, 
by our definition, the initial representation of representable signatures lies in RMon'^. 



7 Strengthening signatures 

Guided by the ideas of Matthes and Uustalu [16] we introduce in our framework the notion of strength- 
ened arity. For a category C, let us denote by End^(C) the category of a»-cocontinuous pointed end- 
ofunctors, i.e., the category of pairs {F,r]) of an oj-cocontinuous endofunctor f of C and a natural 
transformation rj: I — > F from the identity endofunctor to F. A morphism of pointed endofunctors 
/: iFi,T]i) — > iF2,T]2) is a natural transformation /: Fi — > F2 satisfying /0771 = 772- 

Definition 7.1. A strengthened arity is a pair iH,d) where H is an a>-cocontinuous endofunctor of 

End'^(Set) (i.e., H e End'^(End'^(Set))) and 61 is a natural transformation 6: H{-) > H{ ) (where 

H{-y ~ and H{ ) have to be understood as functors from End'^(Set) x End^(Set) to End'^(Set)) 

satisfying 9x,(i,\i) -^hx and such that the following diagram is commutative 



H{X)-Z,-Z2 



Sx.(Zi'Z2.ei-e2) 



H{X-Z,-Z2) 



(1) 



H{X-Z,)-Z2 



for every endofunctor X and pointed endofunctors (Zi,ei), (22,^2). We refer to 9 as the strength on H. 

Our first task is to make clear that our wording is consistent in the sense that a strengthened arity H 
somehow yields a genuine arity H. For this task, for each monad R we pose H{R) '■ = H{R) and we exhibit 
on it a structure of /^-module. We do even slightly more by upgrading H into a module transformer in 
the following sense: 
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Definition 7.2. A module transformer is an endofunctor of the big module category BMod^ which 
commutes with the structural forgetful functor BMod'^ — > Mon'^. 

Let (H, 6) be a strengthened arity. For every a»-cocontinuous monad R and 6>-cocontinuous 7?-module 
M, we define the natural transformation p^^^); H{M) ■ R — > H{M) as the composition H{p^) ■ 6m,r- 
Then {H{M),p^^"^) is an /^-module, and this construction upgrades H into a module transformer denoted 
by H. 

We call the restricion H of the module transformer H to the category of monads the arity associated 
to the strengthened arity H. 

Our next task is to upgrade our favorite examples of arities into strengthened arities: 

• The arity comes from the strengthened arity {H,6) where H and 6 are the relevant identities. 

• The arity * comes from the strengthened arity {H, G) where H is the final endofunctor and G is the 
relevant identity. This is the final strengthened arity. 

• The arity • comes from the strengthened arity {H, G) where H .= X^ XX and Gxj '-X-X-Y — > 
X-Y -X-Y :=X-Tf -X-Y; here we have written rf for the morphism from the identity functor to Y 
(remember that Y is pointed). 

• If an arity comes from a strengthened arity, so does its derivative (see Proposition 7.4). 

Then we show how our basic constructions in the category of arities carries over the category of 
strengthened arities. First we describe this category. Its objects are strengthened arities and we take for 
morphisms from {Hi,G\) to {H2,G2) those natural transformations m: Hi — > H2 which are compatible 
with G\ and G2, that is, the diagram 

Hi{X)-Z-^Hi{X-Z) 

H2{X)-Z^H2{X-Z) 

is commutative for every endofunctor X and every pointed endofunctor Z. 

Theorem 7.3. The category of strengthened arities has finite limits and arbitrary colimits. 

Next, we take care of the derivation. We denote by D the endofunctor of Set given by A 1-^ A + *. For 
any other pointed endofunctor X over Set we have a natural transformation : D X — > X ■ D given by 

: X{A) + * — > X{A + *) wf:= X(/a) + ?7a+* • t 

where '■ A — > A + * and * : * — > A + * are the inclusion maps. 

Proposition 7.4. If {H,G) is a strengthened arity, then the pair {H',G'), where H' := X HiX)' and 
^'xz '~ ^x,zD ■ H(X)w^, is a strengthened arity. We call it the derivative of {H,G). 

Now we point out the possibility of composing strengthened arities. 
Definition 7.5. \f H :- {H,p) and K := {K, cr) are two strengthened arities, their composition H K is the 
pair {H ■ K, G) where G is defined by Gx,{z,e) ■= H{crx,(z,e)) ■ PK(X)xz,e)- 

Proposition 7.6. This composition turns strengthened arities into a strict monoidal category. 

Next, we turn to the main interest of strengthened arities (or signatures) which is that the fixed point 
we are interested in inherits a structure of monad. 

Lemma 7.7. Let {H,G) be a strengthened arity. Then the fixed point T of the functor F :- I + H is oj- 
cocontinuous and comes equipped with a structure of H -representation which is the initial object in the 
category of the H -representations. 
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We say that a signature is strengthened if it is a family of strengthened arities. The previous lemma 
leads immediately to the following result. 
Theorem 7.8. Strengthened signatures are representable. 

8 Examples of strengthened syntax 

Lambda-calculus modulo o'-equivalence One paradigmatic example of syntax with binding is the A- 
calculus. We denote by A(X) the set of lambda-terms up to a-equivalence with free variables 'indexed' 
by the set X. It is well-known [6, 3, 13] that A has a natural structwe of cocontinuous monad where the 
monad composition is given by variable substitution. 

It can be easily verified that application app : — > A and abstraction abs : A' — > A are A-linear 
natural transformations, that is, A is a monad endowed with a representation p of the signature S = 
{app: 0~,abs: 0'}. The monad A is initial in the category Mon^ of w-cocontinuous monads equipped 
with a representation of the signature E. 

This is an example of algebraic signature and thus already treated by other previous works [13, 14, 7]. 
Here we simply remark that our new theory covers such a classical case. 

Explicit composition operator We now consider our first example of non-algebraic signature. On any 
monad R, we have the composition operator (also called join operator) ji^: R R — > R which has arity 
• 0. We will refer to the //^ operator as the implicit composition operator. An interesting problem is to 
see if this kind of operators admits a corresponding explicit version, i.e., if they can be implemented as a 
syntactic construction. As we have seen before • is a strengthened arity hence we can build syntaxes 
with expUcit composition operator of kind 

join: 0-0^0. 

Of course, this is only a syntactic composition operator, in the sense that it does not enjoy several 
desirable conversion rules like associativity, two-side identity and the obvious compatibility rules with 
the other syntactic constructions present in the signature. In our next work we will show how to construct 
such kind of semantic composition operator. 

Let us mention that given a monad R, the unit rjR : / — > R is not an /?-linear morphism (in fact, / is 
not even an /?-module in general). For this reason we cannot treat examples of syntax with explicit unit. 

Syntax and semantics with explicit substitution On any monad R, we have a series of substitution 
operators cr,, : • /?" — > R which simultaneously replace n formal arguments in a term with n given 
terms. As observed by Ghani and Uustalu [12], these substitution morphisms satisfy a series of compati- 
bility relations which mean that they come from a single moiphism subst : C — > where C is identified 
as the coend 

/A:Fin 
0<^)x0^. 

Here Fin stands for a skeleton of the category of finite sets, 0^^ denotes the cartesian power and 0'-'*-* 
is defined by 0^'^\/?,X) := R{X + A). Since coends are special colimits, and strengthened arities admit 
colimits, we just have to check that the bifunctorial arity {A,B)\-^ O^'*^ x0^ factors through the category 
of strengthened arities. As far as objects are concerned, this follows from our results in Section 7. The 
verification of the compatibility of the corresponding "renaming" and "projection" morphisms with the 
strengthened structures is straightforward. 
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